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Abstract 

Conventional edge-based active contours often require the normal component of 
an edge indicator function on the optimal contours to approximate zero, while the 

> : 

. tangential component can still be significant. In real images, the full gradients of 

the edge indicator function along the object boundaries are often small. Hence, the 
curve evolution of edge-based active contours can terminate early before converg- 
ing to the object boundaries with a careless contour initialization. We propose a 

00 ■ 

*0 \ novel Geodesic Snakes (GeoSnakes) active contour that requires the full gradients 

^ 1 of the edge indicator to vanish at the optimal solution. Besides, the conventional 

O ■ curve evolution approach for minimizing active contour energy cannot fully solve 

the Euler-Lagrange (EL) equation of our GeoSnakes active contour, causing a 
Pseudo Stationary Phenomenon (PSP). To address the PSP problem, we propose 
an auxiliary curve evolution equation, named the equilibrium flow (EF) equation. 
Based on the EF and the conventional curve evolution, we obtain a solution to the 
full EL equation of GeoSnakes active contour. Experimental results validate the 
proposed geometrical interpretation of the early termination problem, and they 
also show that the proposed method overcomes the problem. 
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1. Introduction 



Energy minimization provides a principled framework for various fundamen- 
tal computer vision problems. Active contour was proposed for object segmenta- 
tion based on energy minimization. The essential idea of the active contour is to 
model the object boundaries by the contour curves that minimize the functional 
energy which measures the error of boundary detection. The active contour has 
been adopted in many application domains of computer vision, such as surveil- 
lance video analysis BJJ] i2D and medical image analysis Oh fl4£| etc. 

There are both edge-based active contours Q5|] D6D D3J] D7I] Q8|] and region-based 



active contours [|9[] 



There are also some recent attempts on improv- 



ing 



the region based methods [Il3h . and improving the edge based active contours 



Il4j,l8|,ll50. More recently, some efforts have been devoted to convex relaxations 
and global optimization of region based active contour models such as Jl^l . How- 
ever, it is arguable that neither the region-based nor the edge-based model is su- 



perior to the other in general. There are a: 



region based and edge based methods [|17 



so recent efforts on integrating the 



1811 . Generally speaking, the edge- 



based active contours are capable of achieving more accurate boundary extraction 
comparing with region-based active contours, but they generally require careful 
initializations. 

This paper revisits a classic problem with edge-based active contours and pro - 



L14] 



vides some new insights to the problem. In the literature, e.g. [19] 

n n 

[12 If! and J150, the problem is often stated as: when the curve is initialized rela- 
tively arbitrarily, the active contour can stop early and some part of the converged 
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curve can still be far from the boundaries of the objects of interest. We investigate 
the cause of the early termination of curve evolution in general edge-based active 
contours. We observe that the full gradients of the edge indicator function along 
the object boundaries are often small. However, conventional edge-based active 
contours, such as the Geodesic Active Contour (GAC), often only require the 
normal component of the edge indicator function on the optimal contours to ap- 
proximate zero, while the tangential component can be still significant. Based on 
this observation, we propose a novel active contour model: the Geodesic Snakes 
(GeoSnakes) active contour model. The derived Euler-Lagrange (EL) equation of 
the GeoSnakes model requires the full gradients of the edge indicator to be close to 
zero on the optimal contours. However, the conventional curve evolution method 
does not fully solve the EL equation of the GeoSnakes model, although the curve 
evolution can still converge stationarily. This phenomenon is named the Pseudo 
Stationary Phenomenon (PSP). To address the PSP, we propose an auxiliary curve 
evolution equation, named the Equilibrium Flow (EF). The full EL equation of the 
GeoSnakes for boundary extraction is solved by alternating the Equilibrium Flow 
and the conventional gradient descent curve evolution. 

From our point of view, our contributions are as follows. 

1 . We elucidate importance of the tangential component of the gradient of the 
edge indicator along the boundary curve for boundary locating. This ob- 
servation contradicts the conventional view that the tangential component is 
merely a useless reparameterization force. 

2. We obtain a new active contour model of which the EL equation can be 
satisfied by a smooth contour curve if both the normal and tangential com- 
ponents of the gradient of the edge indicator along the contour approach 
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zero. 

3. We obtain a curve evolution method to solve the EL equations containing 
both the normal and tangential components. 

The rest of the paper is organized as follows. In Section |2] we introduce the 
geodesic active contour and the works relevant to the problem of early termination 
of curve evolution. In Section [3l we present our problem statement followed by 
our formulation and solution. In Section HI experiments are conducted to evaluate 
our proposed method and to also valid our theory. In Section |5] we conclude the 
paper and present some further possibilities beyond this paper. This work is based 



on the preliminary observations presented at BMVC 2008 V22\\ 



2. Background 

2.7. The Geodesic Active Contour 

Our discussions are mostly based on the general Geodesic Active Contour 
(GAC) model. The energy functional of GAC is as follows. 



C* = argmin C(C) 



C(C) 



c?\' m ° \c P 



g(VI) 

= / g\\C P \\dp= / gds 
Jo Jc 



dp (1) 



where ds = 1 1 C p \ | dp is the arclength parameterization and the edge indicator func- 
tion g can be defined below. 

* (w) = 1 + ||g!.W||. <2) 
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in which G G is a Gaussian filter of width a, and we may assume q = 2. The 



justifications of this choice of edge indicator can be found in (5D Q23[] Ja]. 
We rewrite the Euler-Lagrange equation of GAC as follows. 

^ = (Vg,N)N- 9 KN = Q (3) 

where k is the curvature of curve C, and N is the normal vector of C. Empirically, 
the smoothing term qk is close to zero on a converged smooth curve. Hence, 
(Vg, N) is also close to zero on the curve. 

2.2. Previous works on the early termination problem in curve evolution 

This subsection will review some pioneering works on this early termination 
problem. Their methods have been proven effective for addressing this problem 
to various degrees. Our approach differs from them in that we aim to not only 
remedy the problem but also investigate the cause of the problem. 

The early termination of local gradient based active contours was first reported 



in [1190. He proposed the Balloon term to push the curve either to shrink or to ex- 
pand before reaching the object boundary. Generally, the Balloons can be applied 



when there is little attraction sensed by the evolving curve. Xu and Prince [20] ob- 
served that the Snakes might not converge to concave boundary even when there 
is large attraction. We quote their statement below. 

Although the external forced correctly point toward the object bound- 
ary, within the boundary concavity the forces point horizontally in 
opposite directions. Therefore, the active contour is pulled apart to- 



khe gradient vectors 
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Figure 1: The U-shape and the opposite gradient vectors 

ward each of the fingers of the U-shape, but not made to progress 
downward into the concavity 

We also reproduce a U-shape as well as the associated normalized velocity 
field in Figured] to visualize the statement above. Based on this observation, Xu 
and Prince [20] also proposed the Gradient Vector Flow (GVF) to extend and 
smooth the gradient field in order to address the problem for extracting objects 
with moderately concave boundaries. This method is tested to be effective for 
moderate boundary concavity. 

Paragios et al. applied the GVF to GAC with the level set method for 
extracting multiple objects. However, they discovered a problem which we quote 
below. 

...the proposed flow does not perform propagation when the iVGwi is 
close to orthogonal to the inward normal ... propagation will not take 
place, as well as change of the topology, even if they are supported by 
the level set technique. 



2 normalized gradient vector flow 
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We can compare this statement above with the observations by Xu and Prince 



[20Q to conclude that both the original Snakes and the level set based active con- 
tours suffer from the same problem. Paragios and his colleagues propose the adap- 
tive balloon to force the active contour to evolve when the normal projection of 
the gradient is close to zero. This idea works for images of relatively simple topol- 
ogy, as shown in our experiments. For images of complex topology, the contour 
might be able to avoid converging to the positions where the normal projection 
of the gradient is close to zero, but it can oscillate near these positions since the 
Adaptive Balloon is formulated to be in the same direction of the external force. 

Li et al. I21I proposed to pre-segment the image before curve evolution. The 
segmentation is based on the geometry of the GVF. By segmenting the image, 
the closed curve can also be cut into smaller ones. However, the segmentation of 
GVF is not in the active contour framework. The cause of the early termination 
problem of the curve evolution of general edge-based active contours was not 
addressed there. 

More recently, Xie and Mirmehdi [15] formulated a novel edge-based curve 
evolution equation motivated by the mathematical formulations of magnetostatic 
/ Lorentz force, as an alternative to the conventional edge-based active contours. 
The curve evolution model was named the Magnetostatic Active Contour (MAC). 
In that paper, the authors conjectured that the early termination of gradient based 
curve evolution can be due to the undesired critical points, such as saddle points 
or maxima. The authors also demonstrated that MAC can surpass the undesired 
critical points and converge to boundaries with severe concavities or boundaries 
of multiple objects for many images while having less constraints on the initial- 
izations. However, MAC is a curve evolution framework, and the curve evolution 
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does not necessarily minimize an energy functional. Hence, MAC is not formu- 
lated under energy minimization framework. Besides, MAC requires the edge 
detection to produce little spurious edge as a preprocessing step. The detected 
edge helps producing an indicator of region homogeneity, and the resultant curve 
evolution behaves like region based active contours as observed in the experiments 
presented in this paper. 

This problem with GAC may be considered as a problem of local optimality of 
the curve evolution based method, but the globally optimal solution of GAC can 
be a dot, because GAC tries to find the contour having minimal weighted contour 
length. 

In the experiments presented later, we will show that our method compares 
favorably to the related methods for object segmentation in images containing 
relatively complex structures. 



3. Active contour with a tangential component 

3.1. An interpretation of the early termination problem 

The object boundaries perceived by human are located at the peaks of the mag- 



nitude of image gradients according to the theory of edge detection 112411 . Based on 
the magnitude of image gradients, an edge indicator function can be formulated 
as in Eq. ([2]). Variants of the edge indicator functions have now been commonly 
used in the formulations of active contours, e.g. [7J. A prototypical edge-based 
active contour is the GAC. In GAC model, the boundary is considered as the con- 
tour corresponding to the minimal GAC energy. The GAC energy is small, if the 
edge indication on the contour is strong. The Euler-Lagrange (EL) equation for 
minimizing the GAC energy requires the gradients of the edge indicator in the 
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normal direction of the optimal curve to approach zero. However, this require- 
ment is insufficient. It has been observed that the curve evolution for solving the 
EL equation often converges at the non-boundary positions where the tangential 
component is still significant In fact, the full gradients of the edge in- 

dicator along the boundaries are often small, i.e. both the normal and tangential 
components of the gradients of the edge indicator along the boundary are close to 
zero, such as Figure El In practice, the gradient field of the edge indicator func- 
tions of images containing noise or spurious edges are topologically complex. In 
such gradient fields, we can easily find the non-boundary curves on which the 
normal component of the gradients is zero but the tangential is non-zero. Some 
more examples can be found in the experiment section. Note that the assumption 
of small gradients along object boundary is not always valid. For example, the 
inhomogeneous region may lead to non-zero gradients on the boundary. The in- 
tensity inhomogeneity in medical images can often be corrected by preprocessing 

Without requiring the tangential component to be close to zero, we should 
not expect to obtain correct object boundaries. In practice, this leads to the early 
termination problem. Figure |3] shows a possible situation of early termination 
of the curve evolution in GAC. Let the curve segments at A and B be the same 
curve segment from two successive iterations of the curve evolution in a vector 
field. The black arrows in Figure |3] (b) denote the actual attraction velocity on 
the contour curves. The attraction velocity is the projection of the vector field, 
visualized by the red arrows, in the normal direction of the curve. As the curve 
evolves, the curve at A at first moves towards position B in the first iteration. 
Then, in the second iteration, the curve at B will move towards A. By using a 
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(a) 



(b) 



Figure 2: The full gradients of the edge indicator near the object boundary are close to 
zero, (a) is an image containing an object of interest. In (b), the center is the edge indicator 
function for (a). The intensity of the edge indicator is visualized by the darkness in figure 
(b). The surrounding patches in (b) show the gradient vector field of the edge indicator 
along the object boundary (dashed curve). 

sufficiently small time step, the curve will finally stop at some place where the 
gradients are nearly orthogonal to the inward/outward normal, but not necessarily 
zero. The curve evolution terminates too early since the curve converges to the 
place in-between the boundaries where the normal components vanishes but not 
the tangential ones. 

3.2. The Geo Snakes and the Pseudo Stationary Phenomenon 

In the following, we propose a new active contour model that requires the full 
gradients of an edge indicator to approach zero at the optimal solution. The model 
is given as follows. 



where o is the function composition operator, lno^oC = ln(#(C)) is the com- 
position of the three functions, g is the edge indicator function defined in Eq. ©. 




(4) 



(a) 



(b) 



Figure 3: The curve stops (or oscillates) when the gradient is nearly orthogonal to the 
inward normal of the curve, (a) is a 3D visualization of a typical edge indication func- 
tion overlayed by the negative gradient field; (b) demonstrates the curve evolution in the 
negative gradient field within the gray-shaded box region in (a). See text for details. 

The corresponding EL equation is the following. 

= "V# - kN = Vg - g*N = 
6C 9 (5) 

(V#, f)f + (Vg, N)N - gi^N = 

where T is the tangential of the contour curve and TV is the normal. The first 
equivalence holds since g is guaranteed positive. Comparing © with @, we can 
observe that © contains an additional tangential component, which is also the 
tangential component of the gradient of the edge indicator. 

There exists geometric and parametric active contours. A discussion regarding 
the relationshipbetween the geometric active contours and the parametric active 



contours is in H26U . The major difference between the two kinds of active contours 
is that the curve evolution equation of parametric active contours may contain a 
tangential component whereas the other one contains only the normal component. 
GAC is a typical geometric active contour. A typical parametric active contour 
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containing tangential component is the original Snakes active contour H27H H26H . 
Note that the normal component in the EL equation of GeoSnakes is accidentally 
the same as that of the GAC. The proposed model is named the Geodesic Snakes 
(GeoSnakes) since it is related to both the GAC and Snakes. 

Now let us turn to the solution to the GeoSnakes model. The conventional so- 
lution to active contour is the gradient descent curve evolution. The corresponding 
curve evolution equation of GeoSnakes is as follows. 

d t C = 9 kN - (V 9) f)f - (V 9) N)N (6) 

Unfortunately, it is commonly believed that the tangential component in the 
curve evolution equations will only automatically reparameterize the contour curve, 
and the tangential component is conventionally omitted in the implementation of 
the curve evolution. This behavior can be explained with the help of the Lemma 



of curve evolution stated in Il28h . 



Lemma 3.1. Given the closed curve C(p ) t) parameterized by arbitrary p 6 B at 
an artificial time t with the normal N, the tangent T of the curve, and given the 
geometric flow of a curve evolution by 

d t C(p, t) = a(p, t)f(C(p, t)) + P(p, t)N(C(p, t)) (7) 

If/3 does not depend on the parametrization, meaning that (5 is a geometric intrin- 
sic characteristic of the curve, then the image ofC(p ) t) that satisfies Equation^} 
is identical to the image of the family of curves C(p ) t), parameterized by p e B, 
that satisfies 

'dtC(p,t)=P(p,t)N(p,t) (8a) 
dp a 



dt ' \\c p \\ 
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(8b) 



The above lemma states that the geometry of the curve evolution only depends on 
the velocity in the normal direction of the curve, although the reparametrization 
by ^ may last forever due to the possibly non-vanishing a. A brief proof of this 



lemma can be found in the book of 112911 . 

The omission of the tangential component in the original EL equation can also 
be seen in the level set method for implementing general curve evolution.Recall 



the level set method for curve evolution Q30[|. 



a t $|„ =0 = (v$,a,c}| $=0 

= (V$, f3N + af) , by Equation© 

$=o 

(9) 

= /9||V$|| 

$=0 

by setting N = => ( v *> T ) = 

All the above says that the curve evolution is independent of the tangential 
velocity on the closed curve. It also implies that the converged solution of Eq. ® 
may not necessarily be the stationary solution of Eq. (|7]). To be specific, there 
may exists a non- vanishing reparametrization velocity, i.e. the tangential velocity, 
on the converged curve. This can be ascertained by rephrasing Lemma I37T1 to be 
the following. 

Corollary 3.2 (Pseudo Stationary Phenomenon). The converged curve of Eq. 
denoted by C{p ) oc) which satisfies 

d t C(p, oo) = (3(C(p, oo))N{C(p, oo)) = (10) 
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can lead to 

d t C(p, oo) = a(C(p, oo))f(C(p, oo)) 

+ /3(C(p,oo))7V(C(p,oo)) (ID 

where p = p(p, t), a = —\\C P \\^, ^ is the parametrization and a(C(p, oo)) can 
be large. C{p ) oo) is the converged curve. 

The above property is termed the Pseudo Stationary Phenomenon (PSP), since the 
stationarily converged curve may not be a solution of the original EL equation 
such as ©. Interestingly, the early termination of GAC is corresponded to the 
PSP of GeoSnakes. 

3.3. The Equilibrium Flow and the Alternating Curve Evolution 

On the one hand, the curve evolutions with only the normal component is 
insufficient for boundary location and the tangential component should also be 
considered. On the other hand, the curve evolutions can only solve for the nor- 
mal component of the curve evolution equation, even when the curve evolution 
equation contains a tangential component. Thus, we find ourselves in a dilemma. 

In the following, we propose a solution to the curve evolution equation with 
a tangential component, i.e., a solution to the PSP problem. The curve evolution 
equation concerned can be written in the most general form as follows. 

d t C = /3(p, t)N(p, t) + ( F(p, t), f (p, t))f (p, t) (12) 

where F is a vector field. The objective is to ensure both the normal component, 
/3, and the tangential component, (F(p, i), T(p, t)) 9 to vanish when the curve evo- 
lution stops. Since the curve evolution is independent of the tangential velocity, 
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the tangential component plays no role in the whole process of curve evolution. 
Therefore, an auxiliary flow termed the Equilibrium Flow (EF) is proposed to en- 
sure the tangential velocity to be zero when the curve evolution stops. The EF 
equation is defined as follows. 

dtCfat) = (F(p,t),T(p,t))N(p,t) (13) 

This equations is named the Equilibrium Flow due to the following property. 

Proposition 3.3. The stationary solution C* of the Eq. ([721) is either on stationary 
points in F or on level sets of the potential g corresponding to the gradient field 
F. 

The proof is given in Appendix. 

Another more interesting property of EF is the following. 

Proposition 3.4. The curve evolution of ([721) an d the reparametrization & = 

~ {P{P fcf\\ P,t)) where F = -^9> leads to d(C(p,t)) = g(C(p,t + r))for any 
r before termination of the curve evolution. 

The proof is given in Appendix. This proposition implies that the function g 
for a fixed p would not change during the curve evolution driven by EF. With a 
proper contour parametrization, the curve evolution driven by EF can solve for the 
tangential component of EL while the energy on the contour will not be changed. 

By using this EF flow, we obtain a solution to the EL equation involving both 
the normal and tangential components, which is formally stated below. 

Proposition 3.5. Given an arbitrary initial curve Co, the convergent curve C (p, oo) 
driven by the following system of flows is the stationary solution of the original 

15 



curve evolution ([72]) as well as the corresponding EL equation. 

dtC* = 0(p, t)N, C*(p, 0) = Ct\p, oo) (14a) 
d t C k 2 = (F, f)N, C k 2 (p, 0) = C*(p, oo) (14b) 

k = l,2,... 

C° 1 (p,0) = C° 2 (p,oc) = C (14c) 
C(t, oo) = lim Ci(r, oo) = lim C^r, oo) 

k—>oo k—>oc 

This claim is true since Eq. (IT2l) can be satisfied only when both the f3 and a 
are zero, and the curve evolutions (I Hat and (I14bt defines a process to ensure the 
f3 and a to be zero respectively. This proposition tells that the alternation of the 
two curve evolutions can provide a solution to the original EL equation containing 
both normal and tangential component, which is previously unknown. 

The derived new curve evolution framework can have the following interpre- 
tation. Starting from an initial contour curve, the curve evolution of (I Hal) may 
converge to a pseudo stationary position, where the PSP occurs. Then the curve 
evolution of (I14bl) can help the curve evolution to escape from the pseudo station- 
ary position. At the convergence of (I14bk the value of the edge indicator at every 
contour point of C{p) can be guaranteed unchanged (by Proposition 13.41) . and the 
curve evolution of (I Hal) has been reactivated because {Vg,N) tends to be large 
according to Proposition 13.31 The process continues until the system of equations 
in ([Hi) converges. 

The curve evolution of (IHbl) cannot be directly implemented in a level set 
framework in which the tangent T cannot be conveniently used. Fortunately, in 
2D case, there is a useful relation that TV = 1ZT, where 1Z is a matrix for ±90 
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degree rotation. Therefore, the EF can be rewritten as follows. 



dtC(p,t) = (F,?)N 



(F T f)N = (F T UN)N 
((n T F) T N)N = (U T F, N)N 



(15) 



The EF (I14bl) in the system Eqs. (I Hal) and (I14bl) can be understood as a 
repositioning process of the curve. The repositioning process can help the curve 
to escape from the pseudo stationary positions. The visualization of the idea of 
EF is presented in Figure |4j The rotation of gradient field can reactivate the curve 
evolution when it is trapped by PSP, while the true stationary positions remain 
stationary. 

3.4. The algorithm 

The problem we discussed previously is general, but we still focus on analyz- 
ing and solving problems with the GeoSnakes where f3 = qk — (Vg, N). We 



adopted the level set method Bill for implementation. The pseudo code is shown 
in Algorithm [T] Note that the maximum iteration is reached if the contour has 
little motion. The maximum cycle is chosen to be 3 in the experiment. 

4. Experimental results 

In this section, we present the experimental results that validate our interpre- 
tation and formulation for solving the early termination problem. The proposed 
method is also compared with other related methods to show the practical useful- 
ness of this work. 
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Figure 4: The practical effect of rotating gradient field. The top left is a typical gradient 
field, visualized by dark blue arrows, in which the green line segment cannot be moved 
by the local gradients due to the PSP. The top right is the vector field generated by the 
rotation, visualized by the arrows in red, in which the line segment can now be moved by 
this vector field. The bottom visualizes both the gradient field and the rotated vector field. 
It shows that the stationary positions, i.e., the light blue curve, remain stationary after the 
rotation 



4.1. Experiment settings 

We describe the details of the parameter settings for implementation of the 
methods for preprocessing and comparison. The detailed implementation can be 
found in the original papers that are cited below. 

Edge map[5]\^j. The a of the Gaussian kernel that is used to generate edge map 
g in Eq. © is empirically chosen to be 3 for all the images; 



GVFn2Uh The diffusion of the edge map g is done by GVF as a preprocessing for 



all the gradient based methods that are evaluated. We compute the GVF by using 
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Algorithm 1 Alternating Curve Evolutions 



Input: Input Image /, MaximumCycle, Maximumlteration 
Output: C k 

1- Ism <= L by anisotropic smoothing 

2: g V/ sm , by Equation [2| 

3: F ^= -g, by Gradient Vector Flow (GVF) 

4: c = 

5: Initialize C 

6: while c <MaximumCycle do 

7: fc = 

8: while k <MaximumIteration do 
9: if mod(cycle, 2) = then 

10: Ck+i <= Ck by the direct gradient decent flow of Eq. (I Hal) 

11: else 

12: Cfc+i C fc by the EF, i.e., Eq. (fBI) . 

13: end if 

14: k = k+l; 

15: end while 

16: c = c+l; 

17: end while 



the source code provided in the GVF web sitqj. We select the parameter /i = 0.1; 



J3/J3/. 



Balloon Hl^lUdl. The Balloon used for comparison is chosen to be positive to 
shrink the curve; 



jhttp : //iacl . ece . jhu . edu/pro jects/gvf /| 
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Adaptive Balloonn321nl4h For comparison, we adopt the version in H32U . which 



is simpler for analysis comparing to II 1411 , while almost equivalent. In our imple- 
mentation A = 1, (3 = 0.1; 



Chan-Vese model UW- We set Ai, A 2 = 1, /i = 0.1, and = which is a Balloon 
term. The S e and iif € are chosen as in [fiol : 

We use Canny edge detection as a preprocessing to specify the current 
along the boundaries of possible objects, and we set the a = 0.5 in the paper for 
all the images; 

Approximated Dirac delta. The approximated delta function 5 e for level set im- 
plementation, excluding Chan-Vese model, are chosen to be as, 



0, \x\ > 1 

|(1 + COS (7TX)), \x\ < 1 



Re-initialization. We adopted the 1 st order accurate Essentially Non-Oscillatory 
(ENOl) based on Baris Sumengen's MATLAB toolbox of the Level Set method 



The Balloon is chosen to be 1. The algorithms are implemented in MATLAB. 
The coding of the active contours is largely inspired by Chunming Li's implemen- 
tatioiR 



4.2. Segmentation results 

Before presenting the main results of the segmentation, the proposed method 
is demonstrated for segmentation of the U-shape in Figured] The result is shown 



jhttp : //barissumengen . com/level_set_methods/| 
^http : / / www . engr . uconn . edu/ ~cmli/| 
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(a) (b) (c) (d) (e) (f) 

Figure 5: Segmentation of the U-shape.(a) is the initialization, (b) is the PSP due to the 
curve evolution by gradient descent, (c)-(f) is the curve evolution by EF. The curve in (f) 
is also stationary to the curve evolution by gradient descent. 

in Figure El 

The other images used for evaluating the proposed method are shown in Figure 
|7] overlaid with the red initial curves. The same initializations are used in all 
the comparisons. The initial curves are partially inside the objects and partially 
outside, which means that solely shrinking or solely expanding the initial curves 
cannot extract the objects. The image sizes can be found in Table [U The chosen 
images are of different characteristics. The image of two rectangles in Figure 
lit a) is relatively simple for segmentation since the gray level of both foreground 
and background are homogeneous and distinct, the edges are strong too. Besides, 
there are only two objects, hence the topology is simple. In Figure Hb), the image 
is also simple except that there are three objects, which is a little more difficult 
than the former one. In Figure |7jc), there are nine curve segments forming three 
circles. The edge-based active contours may see three circles of disconnected 
boundaries in the image, and the region-based method may see the objects in the 
image as composed of nine narrow and curved regions. Figures Hd) and He) are 
MRI medical images of human brain with multiple tumor regions. The original 
brain scans are in Figure |6] From Figures EZld) and (e), we see that there are 
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many spurious curved-edges in the images. Besides, there are some regions with 
intensities similar to the targeted tumor regions. These make the region-based 
active contour to be unsuitable for such images. For edge-based active contours, 
there also exists the Pseudo Stationary Phenomenon. 




Figure 6: The original real images and the tumor regions (in boxes) 



(a) (b) (c) (d) (e) 

Figure 7: Inputs and initializations 

In Figure [H we visualize the normalized gradient field of the edge indication 
functions of the images in Figures [7] (a), (b) and (c) respectively to demonstrate 
the PSP. We also visualize the saddle points by the blue dots on the red lines of 
which the gradients are in the tangential direction. Later we shall see the early 
termination problem of GAC, i.e. the PSP problem of the GeoSnakes, near those 
lines. 
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(a) (b) (c) 

Figure 8: Gradient fields, PSP and Saddle points 
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Figure 9: Object Extraction by proposed method. The top row is the curve evolution by 
GAC; The middle is the curve evolution by EF; The bottom row is the final convergence. 



The curve evolution process of the system of alternating curve evolutions fol- 
lowing (fT4l) . called the GAC+EF, are shown in Figured The objects are correctly 
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segmented. Figure [TUl shows the segmentation results produced by other methods, 
including the GAC, GAC with Balloon, GAC with adaptive Balloon, MAC and 
the Chan-Vese model, with the same initialization shown in U\ It can be observed 
that none of these compared methods can extract all the objects accurately like 
GAC+EF. GAC suffers from the early stop of the curve evolution. GAC with Bal- 
loon can surpass edges and converge to the interior boundaries or vanish; GAC 
with adaptive Balloon can be applied for extracting 2 objects of simple topology 
as shown in Figure [10l yet it still suffers from the PSP in other images. The gradi- 
ent field used for the former three methods are extended by Gradient Vector Flow. 
Interestingly, both the GAC and the GAC with the adaptive Balloon might stop 
quite close to the Pseudo Stationary Positions as shown in Figure [3l while GAC 
with adaptive Balloon can escape from some Pseudo Stationary Positions of rel- 
atively simple topology. It can also be observed that both MAC and Chan-Vese 
model can extract the narrow curved regions in the image of three disconnected 
circles shown in Figure [10l It implies that MAC shares certain characteristics of 
the region based methods. The edge detection process in MAC does not produce 
a local gradient field but the indication of intensity homogeneity. The Chan-Vese 
active contour is not sensitive to initialization but it often captures other undesired 
regions. The MAC generally fails to converge to the object boundaries if there are 
too many edges and corners distributed everywhere in the images. 

Figure [TT1 visualizes the 3D tumor model that is obtained by the segmentation 
of the entire MRI sequence of Figure [T^e) using GAC+EF. The cutting plate cor- 
responds to the segmentation result shown in the bottom right corner in Figure 
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4.3. The tangential and normal velocities 

In the following, a quantitative analysis of the proposed method is provided. 
From the quantitative results, the stable convergence of the curve evolution algo- 
rithms can also be observed. One major contribution in this paper is about the 
proposed solution, namely the EF, to the Pseudo Stationary Phenomenon that oc- 
curs if the tangential velocity on the converged curve does not vanish. The quan- 
titative results demonstrate that the proposed method can reduce the tangential 
velocity effectively. The tangential velocity in the curve evolutions of the pro- 
posed method is shown in the second row from top in Figure [111 The tangential 
velocity is quite large when GAC converges (0-kl), but due to the EF (k2-k4) the 
tangential velocity approaches zero, where k3 is the iteration of convergence. The 
velocities do not reach zero exactly because of the errors in discretization. The 
normal velocity in the third row from top in Figure O shows that the normal ve- 
locity drops significantly during the direct curve evolutions of the gradient descent 
flow. The iterations corresponding to kl, k2, k3, and k4 in Figure 3.12 are given 
in Table Q] The computational times for the curve evolutions are also presented. 
The computational cost can be reduced by using fast implementations, e.g. 1 33^ 

HQ. 



5. Discussions and conclusion 

The PSP problem may happen not only in object segmentation. It may also 
exist in other computer vision or computer graphics tasks involving optimizing 
closed curves. Hence, the proposed method may be extended to address the PSP 
in the different contexts. The proposed method is derived based on geometrical 
observations and analysis of the PSP problem. Experimentally, it shows that the 



25 



Table 1: Image sizes, key iterations in Figure [T2l and time costs of the curve evolutions 



Input Image size 
image (px) 











Total 


GAC 


EF 


kl 


k2 


k3 


k4 


time 


time 


time 










(s) 


(s) 


(s) 



80x80 150 300 900 1800 62.44 4.68 18.73 



80x80 230 - 800 62.33 7.17 15.58 



80x80 200 - 920 63.34 6.33 19.64 



8 



D C 



128x128 110 - 1600 119.44 6.57 77.64 

128x128 120 - 850 120.23 7.21 33.06 

EF repositions the curve to escape from the PSP. This suggests that one may also 
approach the PSP from the perspective of repositioning a pseudo-stationary curve. 
The assumption of small gradients along object boundary is not always valid. For 
example, the inhomogeneous region may leads to inhomogeneous gradients. This 
paper addresses the issue of early termination of curve evolution for images con- 
taining moderately complex structures and relatively homogeneous regions. The 
intensity inhomogeneity in the medical images can be corrected by preprocessing 
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[ 2511 . This work provides new geometric insights of the problem of early termina- 
tion of the curve evolution for general edge-based active contours, giving rise to 
new criteria and solution of edge-based active contours. 



Appendix A. Proofs 

Appendix A.l. Proof of Proposition \3. 3\ 

Proof Since (F(C*),f(C*)) = 0, we can directly obtain 

N(C*) = F }°^ (A.l) 
\\F(C*)\\ 

or, 

F(C*) = (A.2) 
which is one of the definitions of level set, and this completes the proof. 
Appendix A.2. Proof of Proposition ^. 4\ 

Proof Substituting ([13]) and & into ^, we obtain the following. 

rfc _ dc_dp_ 

dt dt dp dt 

= (F,T)N — (F,N)f 

= (F, K T N)N + (F, TZ T f)f ( A3 ) 
= (1ZF, N)N + (1ZF, f)f 
= -KVg(p,t) 

where 1Z is a 90° rotation matrix of size 2x2. Thus, taking derivative of g w.r.t. 
t we obtain the following. 

d dC 

-j t = V 9(P,t)— = -{Vg(p,t),KVg(p,t)) = (A.4) 
which completes the proof. 
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Figure 10: Results by other methods. First column from the left is the object extraction by 

GAC; Second column is the object extraction by GAC with Balloon; Third column is the 

object extraction by GAC with adaptive Balloon; Fourth column is the object extraction 

by MAC; Last column is the object extraction by Chan-Vese active contour. 
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Figure 11: The reconstructed 3D tumor from the MRI sequence of Figure He). The 
cutting plate corresponds to the segmentation result shown in the right most figure in 
Figure [9jc) 
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Figure 12: The normal and tangential velocities during curve evolutions. The top row 
shows the total magnitude of the tangential velocity along the curves; The second row 
shows the total magnitude of the normal velocity along the curves. kl,k2,k3,k4 area some 
key iterations in the curve evolutions. 0-k2 is the curve evolution by GAC; k2-k4 is by 
EF; from k4 onwards is by GAC 
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